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© Devices, systems and methods for implementing a Kanerva memory. 

@ A memory system 10 is provided including a processor 12 and an active memory device 14 coupled to a 
processor 12. Active memory 14 includes a first memory 20 for storing a plurality of possible addresses 
and a second memory 22 for storing an actual address received from processor 12. Circuitry 26 is 
provided for identifying at least one active address from ones of the possible addresses stored in first 
memory 20 as a function of the actual address stored in second memory 22. 
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TECHNICAL FIELD OF THE INVENTION 

The present invention relates in general to digital 
memories and in particular to devices, systems, and 
methods for implementing a Kanerva memory. 

BACKGROUND OF THE INVENTION 

A Kanerva memory system is random access 
memory system which uses long addresses, typically 
In the range of 1 00 to 1 0000 bits, to store and retrieve 
information. Most importantly, Kanerva memories 
are associative such that storage locations do not 
have to be precisely addressed. The address space 
is partitioned into a number of key addresses. A set 
of addresses within a Hamming distance of the key 
address (the Hamming distance being the number of 
bit positions in which two N-bit binary vectors differ) 
"activate" that key address allowing access to a stor- 
age element associated with that key address. The 
Hamming distance (or radius of capture) may vary 
from key address to key address. Each storage ele- 
ment includes a series of multibit counters or regis- 
ters, each storing data as a signed integer typcially 
represented by 2-8 binary bits. One counter or regis- 
ter is provided in each element for each bit position in 
the data words being stored/retrieved. 

When an actual address is received by the Ka- 
nerva memory requesting access, a test is performed 
to determine which key address or addresses are ac- 
tivated. During a read operation a number of key ad- 
dresses may be activated and a best-average value 
is determined for the data retrieved from the corre- 
sponding storage elements accessed. During a write 
to an accessed storage element, a logic 1 at a given 
bit position of a data word being written to the element 
increments the corresponding counter while a logic 0 
at a given bit position decrements the corresponding 
counter. 

Kanerva memory systems are useful many data 
processing applications requiring associative mem- 
ory, such as pattern recognition and pattern classifi- 
cation. Thus, the need has arisen for a fast, simple 
and inexpensive Implementations of Kanerva memor- 
ies. 

SUMMARY OF THE INVENTION 

According to embodiments of the present inven- 
tion, a memory system is provided which includes a 
processor and an active memory coupled to the proc- 
essor. The active memory includes a first memory for 
storing a plurality of possible addresses and a second 
memory for storing an actual address received from 
the processor. Circuitry for Identifying Is provided 
which identifies at least one active address from the 
possible addresses stored in the first memory as a 
function of the actual address stored in the second 



memory. 

According to further embodiments of the present 
invention, a memory system is provided which in- 
cludes a processor and an active memory coupled to 

5 the processor. The active memory includes a data 
memory for storing a plurality of possible addresses 
and data associated with each of the addresses. A 
broadcast memory is also provided for storing an ac- 
tual address received from the processor. The active 

10 memory includes circuitry for identifying from the ad- 
dresses stored in the data memory an active address 
within a Hamming distance of the actual address 
word stored in the broadcast memory. The active 
memory further includes circuitry for accessing the 

15 data stored in the data memory associated with the 
active address and a controller. The controller is op- 
erable to control the transfer of the address words 
from the data memory to the circuitry for identifying 
and the transfer of the actual address from the broad- 

20 cast memory to the circuitry for identifying. 

The embodiments of the present invention are 
useful in many data processing applications. In par- 
ticular embodiments of the present are useful in con- 
structing fast, simple and inexpensive implementa- 

25 tions of Kanerva memories. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the pres- 
30 ent invention, and the advantages thereof, reference 
is now made to the following descriptions taken in 
conjunction with the accompanying drawings, in 
which: 

FIGURE 1 is a functional block diagram of a 
35 memory system embodying concepts of the pres- 
ent invention; 

FIGURE 2 is a detailed functional block diagram 
of the active memory depicted in FIGURE 1; 
FIGURE 3 is a schematic diagram of part of the 
40 circuitry implemented in the datapath depicted in 
FIGURE 2; and 

FIGURE 4 is functional block diagram of a sec- 
ond memory system embodying concepts of the 
present Invention. 

45 

DETAILED DESCRIPTION OF THE INVENTION 

The preferred embodiments of the present inven- 
tion and their advantages are best understood by re- 
st) ferring to FIGURES 1 through 4 of the drawings, like 
numerals being used for like and corresponding parts 
of the various drawings. 

FIGURE 1 1s a block diagram of a Kanerva mem- 
ory system 1 0 embodying the concepts of the present 
55 invention. Kanvera memory system 10 includes a 
master processor 12, an active memory devices 14 
and a system data memory 15. Master processor 12 
exchanges data with active memory devices 14 via 
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data bus 1 6 and with system data memory 15 via data 
bus 17. As discussed further below, the "data 0 being 
exchanged on bus 16 are primarily addresses to the 
system data memory 15. Read/write addresses are 
provided to active memory 14 via address bus 1 8. Ad- 
dresses retrieved from active memories 14 are com- 
municated to system data memory 1 5 via address bus 
19. Preferably, each active memory 14 in system 10 
has a pin configuration compatible with the pin con- 
figuration of a chosen conventional ("inactive") mem- 
ory unit (for example a 28-pin pinout). In this fashion, 
active memories 14 and conventional inactive mem- 
ories can be interchanged on a given board or other 
supporting structures. 

In general, master processor 12 stores a number 
of possible addresses to data memory 15 in active 
memory devices 14. The possible addresses may be 
randomly chosen and depending on the size of the 
memory formed by memory devices 14 may number 
from 1,000 to 1,000,000 addresses. When access to 
locations in the system data memory 15 is required, 
an actual address is sent to active memory 14 by 
master processor 12. Active memory 14 then deter- 
mines which possible addresses stored therein are 
active addresses by cycling through the stored ad- 
dresses and identifying which ones are within the 
Hamming distance of the address received by system 
10. The identified active addresses are then used by 
master processor 1 2 to access locations in data mem- 
ory 15. During a read request, the data retrieved from 
the accessed locations in data memory 1 5 with each 
active address provided to master processor 1 2 which 
accumulates the data, compares it against a thresh- 
old, and provides a result corresponding to the actual 
address. During a write, data from processor 12 pro- 
vided on data bus 1 8 alters the currently stored data 
in an accessed location by incrementing or decre- 
menting the counters (or registers) in system data 
memory 15 corresponding to each bit on data bus 17. 

FIGURE 2 is a functional block diagram of an ac- 
tive memory 14 embodying the concepts of the pres- 
ent Invention. Active memory 14 may be constructed 
as a single chip or module (a "device") which includes 
a data random access memory 20 (RAM), a broad- 
cast RAM 22, a controller 24 and datapath 26. In the 
single chip embodiment, data RAM 20 and broadcast 
RAM 22 may be fabricated in a standardized config- 
uration for a given set of devices while controller 24 
and datapath 26 are customized to meet the opera- 
tional requirements for a given device or subset of de- 
vices. 

Data RAM 20 may be either a static random ac- 
cess memory (SRAM) or a dynamic random access 
memory array (DRAM). In FIGURE 2, RAM 20 is de- 
picted as a 2k x 8 memory arranged as 128 rows and 
128 columns of RAM cells. It should be noted that in 
addition to the configuration shown in FIGURE 2, any 
one of a number of alternate RAM architectures may 



also be used, as is understood in the art. Associated 
with data RAM 20 is read/write circuitry for reading 
and writing data to and from selected cells in the array 
Including row address circuitry 28, a row address mul- 

5 tiplexer 30, first stage decoding (column address) cir- 
cuitry 32, column address multiplexer 34 and in- 
put/output circuitry 36. Multiplexer 30 passes ad- 
dress bits to the row address circuitry 28 from either 
system address bus 1 8 or from the controller 24. The 

10 selection can be made in response to either a discrete 
signal or in response to the value of the address itself. 
Similarly, multiplexer 34 passes address bits from 
either the address bus 18 or from controller 24. Mul- 
tiplexers 30 and 34 along with input/output circuitry 

15 36 allow for the transfer of bits of data between the 
cells of data RAM either CPU 12 using data bus 16 
and address bus 18 or datapath 26 using internal bus 
38. 

In the embodiment of FIGURE 2, first stage de- 

20 coder 32 multiplexes each set of four adjacent bitllnes 
using multiplexers 33 to form an internal bus 38 which 
is 32 bits wide. I/O circuitry 36 includes a four to one 
multiplexer which selects, in response from address 
bits from address bus 1 8, one of fou r sets of eig ht ad- 

25 jacent bits on 32-bit internal bus 38 for communica- 
tion with the system data bus 16. It should be noted 
that in alternate embodiments the configuration of 
first stage decoder 32 and input/output circuitry 36 
may vary depending on such factors as the width of 

30 Internal bus 38, the configuration of data RAM 20 and 
the number of lines (bits) communicating with system 
data bus 16. 

Broadcast RAM 22 may also be either static or 
dynamic and is similarly associated with read/ write 

35 circuitry for writing and reading data into and out of its 
memory cell array, including row address circuitry 40, 
row address multiplexer 42, first stage (column) de- 
coding circuitry 44, multiplexer 46 and input/output 
circuitry 48. In FIGURE 2, broadcast RAM 22 is or- 

40 ganized as 2 rows and 128 columns, although alter- 
nate row/column organizations may be used in other 
embodiments. The read/write circuitry associated 
with broadcast RAM 22 operates similar to the 
read/write circuitry associated with data RAM 20. 

45 First stage decoder circuitry 44 includes multiplexers 
45 for performing 4:1 multiplexing on each four adja- 
cent columns of the 128 columns memory cells In 
broadcast RAM 22 with the selected 32 bits coupled 
to datapath 26 via a second internal bus 50. Multiplex- 

so ers 42 and 46 selectively pass address bits from eith- 
er system address bus 18 or from controller 24. Thus, 
multiplexers 42 and 46 along with input/output circui- 
try 48 allow for the transfer of data between the cells 
of broadcast RAM 22 from either CPU 1 2 via or from 

55 controller 24 through datapath 26. 

As with the corresponding read/write circuitry as- 
sociated with data RAM 20, the specific configura- 
tions of row address circuitry 40, multiplexers 42 and 
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46, first stage decode circuitry 44, and input/output 
circuitry 48 will vary based on such factors as the 
numbers of rows and columns in the cell array of 
broadcast RAM 22, the width of internal bus 50, the 
number of bits being received from the system ad- 
dress bus 18 and the number of bits (lines) commu- 
nicating with the system data bus 14. Further, the 
coupling of data bus 16 with input/output circuitry 36 
associated with data RAM 20 and input/output circui- 
try 48 associated with broadcast RAM 22 is prefer- 
ably made through a single set of pins (D0-D7) to pro- 
vide compatibility with conventional memory pinouts. 
Similarly, the coupling of the reacVwrite circuitry as- 
sociated with both data RAM 20 and broadcast RAM 
22 may be made through a single set of pins (also not 
shown). Since active memories 14 are part of the sys- 
tem memory, it is preferable that memories 1 4 take on 
the characteristics of memory chips. In other words, 
Memories 14 should be efficient like memory chips, 
small In size and relying on a minimum number of data 
and address pins which are compatible with the pin 
configurations of conventional ("inactive") memory 
chips. 

Datapath 26 may be implemented in random log- 
ic, in programmable gate array circuitry, or in pro- 
grammable logic array circuitry, as required to cus- 
tomize the chip or unit to perform desired computa- 
tional functions. Further, both controller 24 and data- 
path 26 may together be implemented in digital signal 
processing circuitry, such as that found in the Texas 
Instruments TI-320 family of digital signal proces- 
sors. 

In the preferred embodiment of system 1 0, each 
Broadcast RAM 22 is placed at the highest address 
space available for the corresponding number of ad- 
dress bits received by active memories 14 from sys- 
tem address bus 18 This allows each broadcast RAM 
22 to be written to or read from without a chip select 
signal. Further, all the broadcast RAMs 22 of the ac- 
tive memories 14 in system 10 can be accessed si- 
multaneously. 

In the Illustrated Kanerva memory embodiment, 
master processor loads data RAM 20 with a number 
of randomly chosen addresses using data bus 16 and 
address bus 18. These addresses may be in the 
range of 100 to 10,000 bits in length. In the 32-bit ar- 
chitecture shown, the addresses are cycled In as 32- 
bit words via internal bus 38 and multiplexers 33. 
When a request for access to system data memory 1 5 
is required, an actual address 1 0 is written into broad- 
cast RAM 22 by master processor 12. Under direction 
of control instructions received from processor 12 
held In broadcast RAM 22, controller 24 cyclically re- 
trieves the addresses held in data RAM 20. As the ad- 
dresses are retrieved from data RAM 20, a determi- 
nation is made in datapath 26 as to which addresses 
are within the Hamming distance of the actual ad- 
dress held in broadcast RAM 22 (i.e. active). The 



identified active addresses can then be retrieved 
from data RAM 22 by master processor 1 2 for access- 
ing elements in system memory 15. Processor 12 can 
either poll active memories 14 and periodically re- 

5 trieve active addresses or active memories 14 can in- 
terrupt processor 12. 

FIGURE 3 illustrates one possible embodiment 
of the circuitry in datapath 26 which determines which 
addresses from data RAM 20 are active addresses. 

10 The Hamming distance in this embodiment is deter- 
mined using a plurality of exclusive-OR gates 52 and 
counting/ comparing. For an active memory device 
14 having 32-bit internal buses 38 and 50, 32 exclu- 
sive-OR gates 52 are used. A pair of corresponding 

15 lines At and B t from internal bus 38 and internal bus 
50 respectively are received at the inputs of each gate 
52. In other words, the first line from internal bus 38 
(Ai) is gated with the first line from internal bus 50 
(B t ), and so on. The number of logic Vs output from 

20 gates 52 for each address retrieved from data RAM 
20 are counted up and compared against a threshold 
by counting comparing circuitry 54 to determine if the 
address from RAM 20 is within the Hamming distance 
of the actual address. 

25 FIGURE 4 depicts an alternate embodiment of 
Kanerva memory 10. In this embodiment, active 
memories 14 also act as the system data memory. 
Each possible address is stored in data RAM along 
with associated data. When an identification of an ac- 

30 tive address occurs, the associated data is simply re- 
trieved from active memory 14 by master processor 
12. As controller 24 cycles through the addresses in 
data RAM 20 for a given read request and a number 
of active address are consequently activated, multi- 

35 pie words of associated data are made available. The 
associated data from each active address is then ac- 
cumulated either in datapath 26 or by processor 12. 

For performing writes using active addresses in 
the embodiment of FIGURE 4, datapath 26 includes 

40 incrementing/decrementing capability. During a write 
to an active address, the data associated with that ac- 
tive address is read, incremented as discussed 
above, and the new data written back to the same lo- 
cations in data RAM 20. 

45 Although the present invention and its advantag- 
es have been described in detail, it should be under- 
stood that various changes, substitutions and altera- 
tions can be made herein without departing from the 
spirit and scope of the invention as defined by the ap- 

50 pended claims. 



Claims 

55 1 . A memory system comprising: 
a processor; and 

an active memory coupled to said processor 
comprising: 
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first memory for storing a plurality of possible ad- 
dresses; 

second memory for storing an actual address re- 
ceived from said processor; 
circuitry for identifying at least one active ad- 
dress from ones of said possible addresses stor- 
ed in said first memory as a function of a said ac- 
tual address stored in said second memory. 

2. The memory system of claim 1 , wherein said ac- 
tive memory includes circuitry for presenting said 
at least one active address to said processor, said 
processor operable to address an associated 
system memory with said at least one active ad- 
dress. 

3. The memory system of claim 1 or claim 2 and fur- 
ther comprising control circuitry for controlling 
the transfer of said ones of said possible address- 
es from said first memory to said circuitry for 
identifying and said actual address from said 
second memory to said circuitry for identifying. 

4. The memory system of any preceding claim and 
wherein said circuitry for identifying is operable 
to identify said at least one active address by 
identifying at least one said possible address 
within a Hamming distance of said actual ad- 
dress. 

5. The memory system of claim 3, wherein said con- 
trol circuitry comprises: 

first memory read/write circuitry for transferring 
said ones of said possible addresses from said 
first memory to said circuitry for identifying; 
second memory read/write circuitry for transfer- 
ring said actual address from said second mem- 
ory to said circuitry for identifying; and 
a controller coupled to said first and second 
read/write circuitry for controlling the sequential 
transfer of said ones of said possible addresses 
to said circuitry for identifying and the transfer of 
said actual address to said circuitry for identify- 
ing. 

6. The memory system of claim 5, wherein said con- 
troller operates in accordance with control in- 
structions stored in said second memory. 

7. The memory system of claim 5 or claim 6 and fur- 
ther comprising first input/output circuitry cou- 
pled to said first read/write circuitry for selectively 
transferring said possible addresses from said 
processor to said first memory and second in- 
put/output circuitry coupled to said second 
read/ write for selectively transferring said actual 
address from said processor to said second 
memory. 



8. The memory system of any preceding claim, 
wherein said active memory is fabricated as a 
single device; said single device having a pin con- 
figuration compatible with a pin configuration of 

5 a selected inactive memory device. 

9. A memory system as claimed in any preceding 
claim and wherein said first memory is a data 
memory additionally storing data associated with 

10 each said address. 

10. A memory system as claimed in claim 9 compris- 
ing: 

a processor; and wherein said active memo in- 

15 eludes: 

a broadcast memory for storing an actual ad- 
dress received from said processor, and 
circuitry for accessing said data stored in said 
data memory associated with said active ad- 

20 dress. 

11. The memory system of claim 1 0 and further com- 
prising circuitry for retrieving from said data 
memory said data associated with said active ad- 

25 dress. 

12. The memory system of claim 10 or claim 11 and 
further comprising circuitry for modifying during 
a write said data associated with said active ad- 

30 dress in accordance with a data word received 
from said processor. 

13. The memory system of claim 12, wherein said cir- 
cuitry for modifying during a write increments at 

35 least one bit in data associated with said active 
address in accordance with a corresponding logic 
1 received from said processor and decrements 
said bit in accordance with a corresponding logic 
0 received from said processor. 

40 

14. The memory system of claim 12, wherein said cir- 
cuitry for modifying during a write retrieve re- 
trieves said bit of said data associated with active 
address, increments or decrements said at least 

45 one bit, and writes a modified said bit into said 
data memory. 

15. A memory system of any preceding claim ar- 
ranged as a Kanerva memory system. 

50 

16. A memory system as claimed in any of claims 10 
to 15 and including: a system data memory hav- 
ing a plurality of data storage elements each ac- 
cessible by an active address received from said 

55 processor. 

17. A memory system as claimed in any of claims 10 
to 16 and wherein said broadcast memory is 
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adapted for storing control words. 

18. A memory system as claimed in any of claims 10 
to 17 and including data memory control circuitry 

for selectively transferring said address words 5 
between said data memory and a first internal 
bus. 

19. A memory system as claimed in claim 18 and in- 
cluding broadcast memory broadcast memory 10 
control circuitry for selectively transferring said 
control words and said actual address word be- 
tween said broadcast memory and a second in- 
ternal bus. 

15 

20. A memory system as claimed in any of claims 10 
to 1 9 and wherein said controller is operable in re- 
sponse to ones of said control words retrieved 
from said broadcast memory to control the se- 
quential transfer of said address words from said 20 
data memory to said datapath via said first bus 

and the transfer of said actual address to data- 
path via said second bus. 

21. The memory system of any of claims 18to20and 25 
further comprising data memory input/output cir- 
cuitry for controlling the transfer of said address 
words from said processor to said data memory 

via said first internal bus. 

30 

22. The memory system of any of claims 19 to 21 and 
further comprising broadcast memory input/out- 
put circuitry for controlling the transfer of said ac- 
tual address word from said processor to said 
broadcast memory via said second internal bus. 35 

23. A method of implementing a Kanerva memory 
comprising the steps of storing a plurality of pos- 
sible addresses in a first set of storage locations 

in an active memory device; 40 
storing an actual address in a second set of stor- 
age locations in the active memory device; 
identifying active addresses from the plurality of 
possible addresses stored in the first set of loca- 
tions as a function of the actual address stored 45 
in the second set of storage locations using cir- 
cuitry on the active memory device; and 
addressing a system data storage memory using 
the active addresses identified on the active 
memory device. so 

24. The method of claim 23, wherein said step of 
identifying active addresses comprises the step 
of identifying ones of the possible addresses 
which are within a Hamming distance of the ac- ss 
tual address. 
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